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1 .  Overview 

Biological  systems  demonstrate  a  high  level  of  flexibility  and  autonomy.  This  project  is 
one  of  a  senes  that  attempt  to  gain  better  understanding  of  how  such  biologically  bSd 
solutions  operate  and  how  their  organization  can  be  exploited  to  improve  artificial 
autonomous  systems. 

A  key  focus  here  is  a  long  studied  phenomenon  in  rodent  navigation.  Neurons  in  the 

resnond  mP  T  f  Called  “Place  ce,ls”> have  been  found  to  individually 

respond  to  specific  regions  m  the  local  environment.  The  organization  of  these  cells  doJs 

not  show  a  simple  topographical  airangement  and  the  exact  pattern  of  responses  remains 

werffir^^e^d  ThSTCe  inV6Stigation  even  now’  over  thirty  years  after  place  cells 
ta  lea^g  aS;t,^  h,PP°CampUS  ‘S  als°  »>  a  **  structure  involved 

A  novel  aspect  of  the  approach  taken  here  is  the  combination  of  sensor  information 
enved  from  a  robotic  platform  with  a  biologically  realistic  model  of  the  hippocampus 
The  intention  is  to  allow  the  robotic  requirements  to  inform  any  conception^ 
hippocampal  function  while  at  the  same  time  allowing  differences  between  robotic 
navigation  solutions  to  be  contrasted  with  more  biologically  plausible  schemes. 

2.  Synopsis  of  prior  work 

In  prior  work  it  was  demonstrated  that  place-cell  like  activity  can  emerge  from  a  highly 
redded  mode  of  the  CA3  portion  of  the  hippocampus  using  limited  seLr^topute  from 

Th  f  T  •'  a,Te  advanced  <th‘>“Sh  ai"  very  limited)  robot  was 

p  ocured.  The  current  robot  includes  vision  as  a  primary  sensory  modality. 

A  very  simple  and  limited  form  of  visual  processing  was  defined  to  support  self- 
Zi  r7!im  t3Sks. Wlthm  a  sta5;c  environment.  Pattern  recognition  in  this  context  is 

™  ?dj°  7  tV  °riented  features’ these  bein8 the  salient  for  self- 

ocahzation  tasks  and  also  sufficient  for  the  present  work.  General  scene  understanding  is 
a  far  more  complex  process  and  well  beyond  the  current  scope.  8 

Input  to  the  hippocampus  occurs  primarily  through  the  entorhinal  cortex.  How  this  incut 
encoded  is  not  well  understood  except  to  the  extent  that  the  entorhinal  cortex  has  cells 
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that  are  strongly  influences  by  spatial  location  within  a  local  environment  but  whose 
activity  cannot  be  easily  correlated  with  immediate  sensory  experience.  The  approach 
taken  here  is  to  extend  landmark  recognition  such  that  coarsely  turned  place  cell-like 
activity  can  be  generated  as  inputs  to  the  model  hippocampus.  While  this  is  obviously  a 
practical  trade-off,  it  is  also  an  example  of  how  the  influence  of  real-world  sensory  data 
can  suggest  factors  in  neural  coding  and  network  organization. 

While  software  development  is  not  a  goal  of  the  current  work,  specialized  software  is 
needed  to  conduct  simulations  of  neural  systems  of  the  form  considered  here.  Such 
software  is  especially  useful  in  those  simulations  involving  large  networks  of  neurons  and 
those  involving  robotic  sensory  inputs.  Simulation  software  has  been  developed  in  an 
object-oriented  fashion  to  facilitate  expansion  as  research  needs  dictate.  This  software  has 
been  used  to  study  rhythmic  behaviors  in  large  networks  of  simple  neurons  and  to 
simulate  highly  detailed  electrophysiological  models  of  individual  neurons. 

Theoretical  methods  have  been  used  to  facilitate  understanding  of  the  hippocampal 
network  and  the  overall  function  of  the  hippocampus,  especially  in  the  context  of 
navigation.  A  common  theoretical  perspective  on  the  hippocampus,  based  on  its  role  in 
learning  and  memory,  is  one  of  an  autoassociative  memory.  Such  a  perspective  does  not 
address  roles  involving  sequence  learning  or  roles  directly  supporting  navigation.  An 
alternate  theoretical  description  in  terms  of  an  abstract  feature  map  or  self-organizing 

map  was  begun  here  and  shows  promise  in  accounting  for  aspects  of  the  hippocampus  not 
addressed  in  other  theories. 

The  dentate  gyrus  is  a  highly  organized  layer  of  cells  that  provides  inputs  to  a  further 
layer  in  the  hippocampus,  that  is,  to  CA3.  A  theoretical  role  has  traditionally  been 
assigned  to  the  dentate  gyrus  in  the  context  of  an  autoassociative  memory  system  as  a 
technique  of  pattern  separation.  For  this  work,  however,  an  alternative  approach  was 
mvestigated.  Based  on  unique  properties  of  dentate  gyrus  anatomy,  a  model  was 
developed  suggesting  that  the  dentate  gyrus  may  play  a  more  direct  role  as  the  front-end 
of  a  process  for  recognizing  complex  patterns.  A  poster  on  this  topic  was  presented  at 
CNS2002  and  a  follow-on  paper  on  the  topic  has  published  in  this  work  period. 

An  integral  component  in  learning  is  the  plasticity  found  in  synaptic  connections  between 
neurons.  In  a  number  of  brain  regions,  including  the  hippocampus,  a  form  of  plasticity 
based  on  highly  exact  timing  relationships  between  inputs  and  the  output  of  a  neuron  has 
been  found  (spike-time  dependent  plasticity  or  STDP).  In  the  sense  that  there  are 
common  themes  to  self-organization  within  the  brain,  this  form  of  plasticity  may  well  be 
one.  Current  neural  models  of  the  hippocampus  do  not  include  this  form  of  plasticity.  For 
this  work,  development  of  a  more  comprehensive  model  including  this  form  of  spike¬ 
time  dependent  plasticity  was  begun  but  has  not  yet  been  completed. 

3 .  Items  accomplished  in  FY2003  work  period 

Networks  of  simple  cell  models  have  been  explored  both  in  this  work  and  by  other 
researchers.  While  some  aspects  of  hippocampal  network  behavior  can  be  studied 
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rough  such  models,  experimental  results  suggest  that  real  cells  have  a  much  more 
e  a  orate  set  of  behaviors  than  would  be  indicated  by  these  simple  models  especially  in 
the  areas  of  synaptic  integration,  plasticity,  and  neuromodulation.  More  detailed  andY 
reahsuc  cell  models  are  needed  from  which  to  form  the  overall  hippocampatttZ 

be  ofhiglra  Apriority  andh  develol’“«  a  realistic  cel>  were  considered  to 

ot  highest  priority  and  became  the  primary  focus  of  activity  during  this  work  period. 

To  better  model  cellular  behaviors,  prior  models  of  hippocampal  pyramidal  cells  were 
reviewed.  One  of  these,  a  CAS  pyramidal  cell  model  developed  by  Traub  et  TL  1994 
was  implemented  in  the  current  simulation  software  and  reviewed  for  use  here.  However 
arge  number  of  experimental  results  have  arisen  since  the  original  development  of  the  ’ 

findings  and  thef  because  of  differences  between  the  new 

ndmgs  and  the  underlying  assumptions  used  in  the  original  model  definition. 

To  directly  incorporate  newer  experimental  findings,  especially  those  involving  channel 

dtHT^  P  lSt,5y’  a  n6W  family  of  hippocampal  pyramidal  cell  models  was 

mnmhnl  §  W  m°del  is  based  on  reaIistic  reconstructions  of  cellular 

orphology  new  measurements  of  channel  properties  in  dendrites,  and  hew 
meas^ement  of  channel  distributions  in  dendrites.  One  complex  part  of  model 
development  is  combining  multiple  experimental  measurements  in  a  way  that  aggregate 
cell  behavior  can  be  reproduced  in  the  model.  In  its  cuixent  state,  the  pyramidaUdl 
model  attempts  to  reproduce  behaviors  most  relevant  to  the  current  work  and  is  not 
necessarily  intended  to  be  a  complete  model  of  all  cell  behaviors.  The  model  was 
presented  as  a  poster  at  SFN  2003. 

A  side  effect  of  developing  a  more  complex  cell  model  was  the  need  to  improve 
simulation  me  hods.  A  new  variant  of  prior  differential  equation  solution  methods  for 
compartmental  models  was  implemented  in  the  simulation  software.  This  method 

T Crank-Nicolson  m*hod  with  Richardson  extrapoS  for  error 
trol  of  variable  time  step  sizes.  While  this  new  method  offered  a  significant 

improvement  over  the  performance  previously  available,  it  became  ap^entThat 
available  computational  resources  would  not  support  a  network  of  detailed  cell  models. 

SJf ^^1*  what  would  otherwise  be  two  different  but  overlapping  models  one  a 
detailed  cell  model  and  the  other  a  network  model  of  simplified  cells,  an  alternative 
approach  was  defined.  For  present  purposes,  it  is  sufficient  to  simulate  a  single  target  cell 
usrng  a  biophysmafty  detailed  model.  All  cells  providing  inputs  to  the  target  celSbe 
lfa  daS  ge“ng  randomly  generated  spike  trains  with  known  statistical  properties 
This  approach  allows  the  target  cell  to  have  the  full  richness  of  cellular  morphS 

coZlexhl  ibUtr!°nS’  ^  Plasticity> while  reta'ning  control  over  the  simulaTion 

anZko  &  ‘ 3  COn;binatl°In  should  a  result  that  is  both  more  scientifically  valid 
and  also  far  less  computationally  expensive.  ^ 
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or  consistency  of  testing,  inputs  can  be  generated  using  a  simulation  of  the  robot 
sensory  data.  There  is  no  reason  in  principle  that  full  robotic  sensoiy  data  cannot  be 
incorporated  using  sensory  preprocessing  as  previously  defined,  but  the  overall  level  of 
complexity  m  the  simulation  suggests  that  this  should  occur  as  a  later  step. 

As  of  the  end  of  the  current  period,  development  of  the  necessary  model  and  simulation 
software  is  well  underway  but  remains  incomplete. 

4.  Publications 

The  following  were  published  or  presented  in  the  current  work  period: 

Baker  JL  (2003)  Is  there  a  support  vector  machine  hiding  in  the  dentate  gyrus? 
Neurocomptmg  52-54:  199-207. 


Baker  JL  and  Olds  JL  (2003)  Emergence  of  a  well-formed  pyramidal  neuron 
e  ectrophysiology  from  a  simple,  biologically  plausible  computational  model.  Society  for 
Neuroscience  Abstract,  Program  No.  377.2 1 .  y 


Copies  of  these  publications  and  updated  technical  memoranda  are  available  under 
separate  cover. 


5. 


Conclusion 


Development  of  a  meaningful  model  of  a  biological  system  is  a  complex  undertaking.  As 

Zr‘ly  u  thC  PI? ?  haS  been  ambitious> but  there  is  a  reasonable  expectation 

that  the  model  can  be  extended  to  a  degree  that  useful  results  can  be  derived. 

^eS«TItS  "f11  bC  UtiIiZ6d  in  the  design  °f  autonom°us  systems  remains  an  open 
question.  Biological  systems  express  a  staggering  degree  of  complexity  The 

computational  burden  of  simulating  a  single  cell,  even  at  a  coarse  level,  suggests  that 
biological  systems  employ  methods  that  are  not  easily  duplicated  using  current 
engineering  practices,  at  least  not  by  direct  simulation. 

toTTr?fi°n<i  Sh°*Uld  T1  l0SC  “f?  °fdemands  on  biological  systems  that  may  not  apply 
artificial  system.  In  general,  biological  systems  are  self-constructing,  self- 

orgamzing,  self-maintaining,  self-reproducing,  operate  using  miniscule  power,  operate 
with  inherently  unreliable  components,  and  are  highly  evolvable.  Artificial  autonomous 
systems  need  not  have  all  these  properties  to  be  useful.  Being  able  to  adapt  biological 

—7  methods  to  exploit  massive  parallel  operation  at  even  a  fraction  the  scale  of 
a  biological  system  would  be  a  significant  step  in  the  engineering  of  artificial 
autonomous  systems.  The  present  work  is  only  one  step  towards  that  objective. 
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